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A/D CONVERSION ARRAY AND IMAGE SENSOR 

TECHNICAL FIELD 

The present invention relates to a technology for 
integrating an A/D converter on the column of an image sensor, 
particularly of a CMOS image sensor, performing digital output, 
and also enabling signals to be read at high-speed. This 
technology is useful for an image sensor having a function to 
intensively read the signals from the image sensor in a short 
time and for an image sensor for high-speed imaging. 

BACKGROUND ART 

The following are the prior art for performing A/D 
conversion in columns of a CMOS image sensor. 

[1] Patent No. 2532374 Description 

[2] A. Simoni, A. Sartori, M. Gottaidi, A. Zorat, "A digital 
vision sensor", Sensors and Actuators, A 46 - 47, pp. 439 - 
443, 1995 

[3] T. Sugiki, S. Ohsawa, H. Miura, M. Sasaki, N. Nakamura, I. 
Inoue, M . Hoshino, Y. Tomizawa, T. Arakawa, "A 60 mW 10b CMOS 
image sensor with column - to - column FPN reduction", Dig. 
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Tech. Papers, Int. Solid-State Circuits Conf., pp. 108 - 109, 
2000 

[4] B. Mansoorian, H. Y. Yee, S. Huang, E. Fossum, "A 250 mW 
60 frames/s 1280 x 720 pixel 9b CMOS digital image sensor", 
Dig. Tech. Papers, Int. Solid-State Circuits Conf., pp. 312 - 
313, 1999 

[5] S. Decker, R. D. McGrath, K. Bremer, C. G. Sodini, "A 256 
x 256 CMOS imaging array with wide dynamic range pixels and 
column-parallel digital output", IEEE J. Solid-State Circuits, 
Vol. 33, No. 12, Dec. 1998 

[6] K. Nagaraj , "Efficient circuit configuration for 
algorithmic analog to digital converters", IEEE Transactions 
on Circuits and Systems II: Analog and digital signal 
processing, Vol. 40, NO. 12, pp. 777 - 785, Dec. 1993 

[1] concerns 8-bit integrating A/D converter elements 
integrated in columns using a lamp signal generator, 
comparator and register. A similar technology is also 
reported in [2] . [3] also concerns integrating A/D converter 
elements in columns, where 10b is implemented using a higher 
precision comparator. In these integrating A/D converters, 
the conversion time is long, and in particular increasing the 
resolution increases the conversion time exponentially, and 
higher resolution cannot be expected in this status. The 
advantage, however, is that linearity is good. 

[4] reports that operating serial comparison type A/D 
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converters are arrayed in columns and operated using a 
capacitor, with which high-speed A/D conversion can be 
possible, so this technology is suitable for an image sensor 
with a high frame rate and a high number of pixels. The 
actually accuracy, however, is still about 8-bits. [5] 
reports on arranging and operating two stages of cyclic type 
A/D converter elements in columns, which is also suitable for 
high-speed A/D conversion. However the circuit scale is large 
since two amplifiers are used. [6] seems to be similar to the 
present invention, but has a different way of using a 
capacitor, and is not considered for integrating it. 

Beside the above, some image sensors having A/D 
conversion elements in pixels have been reported, but these 
are not directly related to the present invention, and are 
therefore omitted here. 

The circuits in [5] of the prior art, which is most 
closely related to the present invention, will be described. 
In this prior art, two stages of 1-bit A/D conversion circuits 
are cascade-connected, and cyclic type A/D conversion is 
performed by returning the output thereof to input as shown in 
Fig. 1. In this method, an amplifier is required for each 
stage, which increases an area and also increases power 
consumption. If this technology is used as an A/D converter 
to be integrated in the column of an image sensor, three 
amplifiers, including an amplifier for noise cancellation and 
an amplifier for an A/D converter, are required for each 



column . 



DISCLOSURE OF THE INVENTION 



Fig. 2 shows the configuration of the CMOS image sensor 
of the present invention, where an A/D converter is integrated 
into a column. The signals which are read to the column read 
circuit in column units are first noise-cancelled, and the 
signals are supplied to the cyclic A/D conversion circuit for 
each pixel. Here A/D conversion at a required resolution is 
performed, and the digital values are read by horizontal 
scanning. Since this is high-speed signal reading, all the 
digital values are not horizontally scanned in series, but a 
plurality of outputs are created and horizontal scanning is 
performed in parts in parallel, or ADC (Analog Digital 
Converter) outputs are multiplexed as shown in Fig. 3, and 
digitized signals are output in parallel via a plurality of 
lines, or many other methods may be used. As mentioned later, 
in Fig. 2 and Fig. 3, a portion of 1, that is the noise 
canceller and the cyclic ADC, may be integrated using one 
amplifier . 



BRIEF DESCRIPTION OF THE DRAWINGS 



Fig. 1 is a diagram depicting a two-stage cyclic A/D 
converter (prior art); 



Fig. 2 is a diagram depicting the configuration of the 
image sensor in which the cyclic A/D converter is integrated 
into a column; 

Fig. 3 is a diagram depicting the configuration of the 
image sensor where the cyclic A/D converter is integrated into 
a column (parallel output) ; 

Fig. 4 is a diagram depicting a circuit configuration 
example of the cyclic A/D converter which performs 1.5-bit A/D 
conversion each time; 

Fig. 5 is a diagram depicting the conversion 
characteristics of the cyclic A/D converter which performs 
1.5-bit A/D conversion per cycle; 

Fig. 6 is a block diagram equivalent to the cyclic A/D 
converter which performs 1.5-bit A/D conversion per cycle; 

Fig. 7 is a timing chart depicting the operation of the 
A/D converter in Fig. 4; 

Fig. 8 is a diagram depicting the cyclic A/D converter 
which performs 1.5-bit A/D conversion in a half cycle; 

Fig. 9 is a timing chart depicting the operation of the 
circuit in Fig. 8; 

Fig. 10 is a diagram depicting the A/D converter for an 
image processor where noise cancellation and A/D conversion 
are integrated; 

Fig. 11 is a diagram depicting the A/D converter for an 
image sensor where noise cancellation, amplification and A/D 
conversion are integrated; 



Fig. 12 is a timing chart depicting the operation of the 
circuit in Fig. 11; 

Fig. 13 is a diagram depicting the three-transistor pixel 
circuit; 

Fig. 14 is a diagram depicting a circuit example when the 
circuit in Fig. 11 is a full differential circuit 
configuration; 

Fig. 15 is a diagram depicting a configuration when the 
circuit for performing A/D conversion in a half cycle and the 
noise cancellation and amplification functions are integrated; 

Fig. 16 is a timing chart depicting the operation of the 
circuit in Fig. 15; 

Fig. 17 is a diagram depicting the A/D converter for an 
image sensor in which an S/H amplifier is installed; 

Fig. 18 is a timing chart depicting the operation of the 
circuit in Fig. 17; and 

Fig. 19 is a diagram depicting the configuration when 
error correction of ADC is performed in the column of the 
image sensor . 

BEST MODE FOR CARRYING OUT THE INVENTION 

As described below, a redundant expression to take three 
values, binaries -1, 0 and 1, for example, per cycle is used 
as the cyclic A/D conversion, but in order to decrease the 
number of data output lines, the redundant expression is 



finally converted into a non-redundant expression, then the 
digital data is horizontally scanned (or partially 
horizontally scanned in the case of parallel output) , and is 
output. If the data rate of output is low, the redundant 
expression may be converted into a non-redundant expression 
after horizontal scanning. This conversion can be performed 
using an adder which performs N + 1 digits of addition in the 
case of N-bits. 

[Example 1] 

The present invention is characterized in that the number 
of amplifiers and the number of capacitors are decreased in 
order to perform cyclic A/D conversion. Fig. 4 shows a 
circuit example of the cyclic A/D converter of the present 
invention which performs 1-bit or 1.5-bit A/D conversion per 
cycle. This function is equivalent to that of Fig. 6. 

Fig. 5 shows the conversion characteristics of the cyclic 
A/D converter in Fig. 4. In Fig. 4, Vrm and V RP correspond to 
Vref and -Vref in Fig. 5. The relationship between the 
digital outputs DO and Dl in Fig. 4, and D and the input 
signal Vin to the comparator (3) in Fig. 5 is as follows. 

[Expression 1] 
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' 1 (D,=1,D 0 =1) (V jn >V ref /4) 
D = j 0 (D 1 =0,D 0 =1) (V rqf I A > V m > -V rqf 1 4) 
-1(D,=0,D 0 =0) (-^/4>V fB ) 



(1) 



In other words, the input is divided into three areas: 
(1) from Vref to -Vref/4, (2) -Vref/4 to Vref/4 and (3) Vref/4 
to Vref, and three value A/D conversion is performed on these 
areas, and digital codes -1, 0 and 1 are assigned. The first 
code becomes the most significant digit. Operation is 
performed according to the characteristics in Fig. 4, and 
output is generated. This operation is given by the following 
expression . 



[Expression 2] 

V =2V. -DxV , (2) 

out m re/ x ' 



In other words, A/D conversion is performed sequentially 
from the significant digit, input is doubled, and a 
predetermined value is subtracted from the A/D converted value, 
so that the output always comes within a ±Vref range, and by 
supplying this result to the input again and repeating the 
same procedure, multi-bit A/D conversion is performed. At 
this time, A/D conversion is performed with three values each 
time (1 digit), so redundancy is generated in the digital 
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value. By this redundancy, a precision demanded for the 
comparator is considerably relaxed, and high precision A/D 
conversion becomes possible. 

In the case of a binary number, each digit takes two 
values, 0 or 1, but in the case when each digit takes three 
values, -1, 0 and 1, this is regarded that 1.5-bit A/D 
conversion is performed in each stage. Actual operation is, 
as shown in Fig. 6, that a switch by the control signal (|)A 
(hereafter <|)A) is turned ON, the input signal is supplied, and 
1.5-bit operation is performed for each stage. Depending on 
the result, operation is performed according to Expression (2). 
This output is stored in the S/H (Sample and Hold) circuit. 
This completes the first 1 cycle. Then switch by the control 
signal (j)B (hereafter (j)B) is turned ON, the switch by (|)A is 
turned OFF, output of the S/H circuit is supplied to the 1.5- 
bit A/D converter, and the same operation is repeated. After 
repeating this N times, N + 1 bits of A/D conversion can be 
performed. 

Fig. 4 shows the circuits which implement functions which 
are the same as Fig. 6, but require less number of amplifiers 
and capacitors. Fig. 7 shows the operation timing chart 
thereof. Fig. 7 shows up to the third cycle. 

In Fig. 4, Vin is sampled first to CI and C2, then C2 is 
connected between the input and output of the inverting 
amplifier (2), and 1.5-bit A/D conversion is performed based 
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on Expression (1) using the two comparators. CI is connected 
to the D/A converter. By this, the following expression is 
computed. 



[Expression 3] 
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V mt (0) = (1 + -j-)V in - D(0) x -L V ref ( 3 ) 



If CI = C2 , Expression (3) is equivalent to Expression 
(2) . Here Vout (0) is the output of the first cycle, and D 
(0) is the first A/D conversion value, that is the value of 
the most significant digit. In order to sample and hold this 
output, the S/H circuit is created in Fig. 6, but in Fig. 4, 
capacitors and switches are controlled so as to implement a 
processing equivalent thereto. Vout (0) has been stored in C2 
So by using CI, the voltage between Vout (0) and the ground 
point is stored, and according to the result of the A/D 
conversion, CI is reconnected between the DAC (Digital Analog 
Converter) and the inverting amplifier (2) , then charges in 
proportion to the difference, that is 

[Expression 4] 

Q = C l {V em (0)-D0)V^ f ) (4) 

are transferred to C2, and as a result the following 
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expression is executed. 



[Expression 5] 

Q(V out (0)-D(l)V^ f ) 



^0) = ^(0) + 



C 2 



(5) 



This is repeated for the required number of cycles. 

By the configuration in Fig. 4, the A/D converter is 
comprised of one inverting amplifier (2) and two capacitors. 
Since the circuit configuration is simple, a plurality of 
these A/D converters can be arranged, and input signals are 
supplied in parallel, so that high-speed A/D conversion can be 
implemented . 

Now basic operation of the circuits will be described. 
First both the capacitors CI and C2 are connected to the input 
(Vin) , and each is charged with voltage Vin. If the 
respective charges are Ql and Q2 , then Ql = CI • Vin, and Q2 = 
C2 • Vin. Then one terminal of the capacitor C2 is connected 
to the output terminal of the inverting amplifier (2). In 
other words, the charges of Q2 have been filled in the 
capacitor C2 from the beginning. One terminal of the 
capacitor CI is switched to be connected to the DAC (Digital 
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Analog Converter) . If the output voltage of the DAC is Vdac, 
the terminal voltage of the capacitor CI changes from Vin to 
Vdac. So the change of the charges stored in the capacitor CI 
become AQ1 = CI (Vin - Vdac) , and this changed amount is 
transferred to the capacitor C2 . As a result, the final 
output becomes Vout - (Q2 + AQ1)/C2 = ( (CI + C2) Vin - CI • 
Vdac)/C2. If CI = C2 is selected, then Vout = 2Vin - Vdac, so 
the basic operation of cyclic A/D conversion, where the input 
is doubled then the output of the DAC is subtracted, can be 
implemented. The conventional cyclic type has an S/H circuit 
in the output of the amplifier, and the output of the S/H 
circuit is sampled and cycled, so the above mentioned basic 
operation is repeated. 

In the case of the circuits proposed by the present 
inventor, this operation is performed by one amplifier, so the 
above mentioned voltage Vin becomes the output voltage Vout of 
the amplifier at the cyclic operation, therefore Vin in the 
above mentioned "charge C2 with Vin" corresponds to Vout 
during the cyclic operation. In other words, C2 has been 
charged with Vin (= Vout) from the beginning, so only CI is 
initially connected to Vout (= Vin) , then connection is simply 
switched to the DAC, whereby Vout = 2Vin - Vdac can be 
computed. In this case as well, CI = C2 is selected. By this, 
the number of capacitors can be decreased compared to the 
prior art. 

In the case of performing both the noise cancellation 
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operation, which will be described later, and the cyclic A/D 
conversion operation, CI is connected between the input Vin 
and the input of the inverting amplifier, and C2 is connected 
between the input and output of the inverting amplifier. The 
charges of C2 are initialized (Q2 =0) in advance, and one end 
of CI is changed form Vs (signal voltage) to VR (reset 
voltage) to cancel the noise. As a result, if CI = C2 has 
been selected, Vout = AQ1/C2 = CI (VS - VR) /C2 = Vs - VR, so 
even if the gain is 1, noise cancellation is performed by 
subtracting VR from VS. Then the cyclic A/D conversion 
operation is started. 

[Example 2] 

Fig. 8 shows an example of circuit wherein 1.5-bit A/D 
conversion can be performed in half a clock by adding 
capacitors and using them alternately. Fig. 9 shows an 
operation timing chart thereof. Fig. 8 shows up to the second 
cycle, where four digits of 1.5-bit A/D conversion is executed 
in two cycles. 

In this case, two sets of comparators (3) are used for 
A/D conversion, but only one set of comparators may be used if 
a switching means is created for switching the input and 
output of one set of comparators, and time division is used. 

[Example 3] 

Such cyclic A/D converters arranged in an array are 
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useful to be used in the column of an image sensor, so that 
signals are supplied in parallel to perform A/D conversion. 
In this case, as Fig. 2 and Fig. 3 show, it is possible that 
noise cancellation circuits, for decreasing noise which the 
pixel section generates in a column, are arranged in a column, 
and the array of the above mentioned A/D converters is 
operated for the output of the noise cancellation circuits, 
but a more efficient circuit configuration is where a noise 
cancellation circuit or a circuit which performs amplification 
with a predetermined gain while canceling noise, and a cyclic 
A/D converter, are integrated, and a circuit for performing 
noise cancellation, amplification and A/D conversion is 
created using one amplifier. 

In the circuit shown in Fig. 10, a signal voltage (VS) by 
a light signal is applied to Vin. This voltage is sampled to 
CI. At this time, the other terminal of CI is connected to 
the input of the inverting amplifier (2) where <|)A and <|)2 are ON, 
and is almost at ground potential. Then the photo-diode 
section is reset after turning (|)A OFF, and the reset voltage VR 
is supplied to Vin. By this, the charges by the product of 
the voltage difference of VR-VS and CI are transferred to C2, 
and the voltage of the amplifier output is changed. If the 
output voltage is Vout (0), this is given by the following 
expression . 

[Expression 6] 
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(V s -v R ) 



(6) 



c 2 



In other words, the difference between the signal level 
of the pixel section and the reset level is amplified by the 
capacitance ratio of C1/C2, and the fixed pattern noise of the 
pixel section can be cancelled. For the output of the 
amplifier, 1.5-bit A/D conversion is performed using two 
comparators (3) , and using this result, an operation to 
perform A/D conversion of the next digit is performed. The 
subsequent operation is the same as Fig. 4. 

The amplification gain in the circuit in Fig. 10 is 
determined by the capacitance ratio of C1/C2. When CI is used 
for noise cancellation and A/D conversion, CI = C2 must be set 
and then the ratio thereof is 1. With the foregoing in view, 
a circuit to increase the amplification degree by adding the 
third capacitor C3 to the input is proposed. Fig. 11 shows 
the circuit example thereof. Fig. 12 shows the operation 
timing chart thereof. 

In Fig. 11, C3 is a capacitor to be used when 
amplification is performed, and if amplification is not 
performed (in other words if noise is cancelled by the gain 1) 
the portion of A enclosed by the broken line in Fig. 11 is 
deleted . 
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By setting C3 = (n - 1) CO, CI = C2 = CO, the noise- 
cancelled signals can be amplified by the gain n times. To 
Vin in Fig. 11, the pixel output of the amplification type 
image sensor using several transistors in a pixel in Fig. 13 
is connected. In this example, the case of using three 
transistors (Fig. 13) is described as an example, but the 
present invention is not limited to this, but can be applied 
to other amplification type image sensors, such as four 
transistors and five transistors, where charges are 
transferred in a pixel. 

In the case of a three-transistor amplification type 
image sensor, the voltage level (Vs), which is generated as a 
result of the signals stored in the photo-diode, is output to 
the selected pixels, and is sampled to CI and C3 in Fig. 11. 
At this time the switch by <|>A is turned ON, the input and 
output of the inverting amplifier (2) are shorted in advance, 
and one of CI and C3 is connected to the input of the 
inverting amplifier (2). Then the switch by <|)A is opened, the 
voltage stored in the photo-diode section is reset (switch by 
R is turned ON) , and the reset voltage level of the photo- 
diode section (VR) at this time is supplied to Vin in Fig. 11. 
By this, the charges by the product of the voltage difference 
of VR-VS and CI + C3 are transferred to C2, and the voltage of 
the amplifier output is changed. If the output voltage 
thereof is Vout (0), this is given by the following expression. 
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[Expression 7 ] 



V nul (0) = ^il^m =n(V s -V R ) (7) 




In other words, the difference between the signal level 
of the pixel section and the reset level is amplified by n 
times, and cancellation of the fixed pattern noise of the 
pixel section and signal amplification can be performed. For 
the output of the amplifier, 1.5-bit A/D conversion is 
performed by two comparators (3) , and using this result, an 
operation to perform A/D conversion of the next digit is 
executed. The subsequent operation is the same as the case in 
Fig. 4, and C3 is used only for the first amplification, and 
is not used for subsequent A/D conversion. 

[Example 4] 

Fig. 11 shows circuits using an amplifier of which one 
terminal is grounded as an example, but this may be structured 
as a full differential circuit. Fig. 14 shows an example of 
circuits which perform processing similar to Fig. 11, where a 
full differential circuit is used. If amplification is not 
performed in Fig. 14, a portion of A is deleted. 

In Fig. 14, which uses a full differential circuit, it is 
assumed that an input signal is supplied as the differential 
voltage of VIP and VIM. If the amplification type image 
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sensor outputs the differential voltage via two signal lines 
in the pixel section, two inputs in Fig. 14 are connected to 
the vertical signal lines from the pixel section. If the 
signal from the pixel section is a single end signal and there 
is only one signal line, VIP in Fig. 14 is connected to the 
vertical signal line from the pixel section, and to VIM in Fig. 
14 a predetermined voltage is supplied as a reference voltage 
in advance. 

[Example 5] 

Fig. 15 shows the circuit configuration when the method 
in Fig. 8, for performing 1.5-bit A/D conversion in a half 
cycle, is used in a column of the image sensor to perform the 
noise cancellation operation. Fig. 16 shows the operation 
timing chart thereof. This operation is roughly the same as 
the case of Fig. 11, but the two sets of the comparators (3) 
are alternately used at every half cycle, and the two 
comparators CI are used for computation corresponding to 
Expression (5) and the sample and hold operation of the output 
at each half cycle. 

Here two sets of comparators (3) are used for A/D 
conversion, but only one set of comparators may be used by 
installing a switching means for the input and output of one 
set of comparators, and by using time division. 

The above is a configuration using a full differential 
circuit for the circuit in Fig. 11, but it is also possible to 
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use a full differential circuit for Fig. 4, Fig. 8 and Fig. 15 
in the same way, and these configurations can be easily 
analogized in Fig. 4, Fig. 8, Fig. 11 and Fig. 14. 

[Example 6] 

In the above circuits, the number of capacitors and 
amplifiers can be decreased, but a function to cancel the 
offset voltage of the amplifier is not available, so it is 
necessary to remove the offset voltage of the amplifier and 
the offset voltage by injection of the switch. For this, the 
offset voltage, which is measured in advance, is subtracted 
for each column in the digital area. However there are some 
cases when this processing cannot be performed easily, and in 
such cases the circuits which are not influenced by the 
variation of the offset voltage of an amplifier very much must 
be used. In this case, another amplifier is required, but 
this extra amplifier may be used as the amplifier for noise 
cancellation of the image sensor for efficiency. 

Fig. 17 shows the circuit example thereof. Fig. 18 shows 
the operation timing thereof. When the signal level of the 
image sensor output is sampled, the image sensor output is 
first connected to the reference voltage V R by the switch 
controlled by <|>A, and is connected between the input and output 
of the amplifier by the switch controlled by (j)2d when 
amplification is performed. By this, noise is cancelled and 
the offset voltage of the amplifier during amplification is 
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cancelled. Also using the same amplifier, cyclic A/D 
conversion, which is a 1.5-bit A/D conversion per cycle, is 
performed. The output of the amplifier is stored by the 
sample and hold circuit. The sample and hold circuit stores 
voltage when the input and output of the amplifier A2 is 
shorted by the switch controlled by <|>2A in the capacitor C4 as 
the reference, then the switches controlled by §2 and <|>2A are 
opened, and C4 is connected between the input and output of 
the amplifier by the switch controlled by (|)ld. Because of this 
the sample and hold circuit is not influenced by the offset 
voltage of the amplifier. 

Then for the A/D conversion of the next digit, the output 
of the sample and hold circuit is sampled to CI and C2 of' the 
circuit in the previous stage. At this time, the voltage, 
when the input and output of the amplifier Al is shorted, is 
sampled by the switch controller by <|>1A as a reference, then C2 
is connected between the input and output of the amplifier by 
the switch controlled by <f>2A, and one terminal of CI is 
connected to the output of the DAC, whereby computation the 
same as Expression (3) is performed, and this operation as 
well is not influenced by the offset voltage of the amplifier 
Al . In this way at both noise cancellation and A/D conversion 
an operation which is not influenced by the offset voltage of 
the amplifier becomes possible. 

The above is the case when 1.5-bit A/D conversion per 
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cycle is repeated using two comparators, but a method of 
repeating 1-bit A/D conversion using one comparator, or a 
method of cycling multi-bit A/D conversion per cycle using a 
plurality of comparators and setting the amplification gain of 
the amplifier 4 times, 8 times or 16 times is also possible, 
and these methods shall not be excluded from the scope of the 
present invention . 

Also a circuit, to correct an error generated by the 
variation of characteristics of the cyclic ADC and a noise 
cancellation circuit, may be integrated in a column as shown 
in Fig. 19. 

Here the inverting amplifier having differential input 
was used for describing the inverting amplifier (2), but it is 
obvious that a similar circuit can be structured, by using an 
inverting amplifier having single end input without 
differential input, and the present invention shall not 
exclude the use of these other amplifiers. 

INDUSTRIAL APPLICABILITY 

The present invention provides a method for performing 
high resolution A/D conversion at high-speed by arranging 
cyclic A/D converters in an array in the columns of an image 
sensor, and a method for implementing a high-speed image 
sensor using the above method. Particularly it is a 
characteristic of the present invention that the number of 
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amplifiers and the number of capacitors are decreased compared 
with a conventional cyclic type, and cyclic A/D conversion is 
performed using an amplifier in a column for canceling noise 
(reset noise, fixed pattern noise) generated at the pixel 
section of the image sensor. By this, area and power 
consumption can be decreased. 
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